How LLM Inference Works
arpitbhayani.me·1d
🔄Subinterpreters
Flag this post
Why Financial Sentiment Analysis Failed Without Explainability (And How I Fixed It)
github.com·11h·
Discuss: DEV
Tokenizer Benchmarks
Flag this post
Learning Tractable Distributions Of Language Model Continuations
arxiv.org·2d
📊LR Parsing
Flag this post
We built a world‑class reranker for RAG
fin.ai·15h·
Discuss: Hacker News
🏗️MLIR
Flag this post
Learning AI From Scratch: Streaming Output, the Secret Sauce Behind Real-Time LLMs
dev.to·6h·
Discuss: DEV
🌊Streaming Lexers
Flag this post
Running a 270M LLM on Android for Offline News Summarization (Notes and Code)
reddit.com·9h·
Discuss: r/LLM
💬Smalltalk VMs
Flag this post
People test Nano Banana with PDF paper to whiteboard. I did the exact opposite
quickchat.ai·9h·
Discuss: Hacker News
🗂️Term Indexing
Flag this post
The Engineering Guide to Efficient LLM Inference: Metrics, Memory, and Mathematics
pub.towardsai.net·2d
🗺️Region Inference
Flag this post
10000
jro.sg·18h
📦Executable Size
Flag this post
Fast and Specialized Rust CSV Readers Using SIMD Instructions
github.com·2d·
Discuss: Hacker News
📋JSON Parsing
Flag this post
Show HN: I ended up vibecoding a full fledged interpreter when ads annoyed me
pseudorun.tech·13h·
Discuss: Hacker News
🌱Minimal Interpreters
Flag this post
Inside ChatGPT: Deconstructing "Attention Is All You Need" (Part 1)
dev.to·1d·
Discuss: DEV
🪜Recursive Descent
Flag this post
The Easiest Way to Build a Type Checker
jimmyhmiller.com·12h·
Discuss: Hacker News
Type Checking
Flag this post
Show HN: LexiForge – Auto-generate vocabulary flashcards from Kindle lookups
medium.com·22h·
Discuss: Hacker News
🌿Trie Structures
Flag this post
Making SLH-DSA 10x-100x Faster
conduition.io·6h
🔗Hash Algorithms
Flag this post
Understanding LLMs as Pattern Machines, Not Thinking Partners
practicalsecurity.substack.com·21h·
Discuss: Substack
🎭Program Synthesis
Flag this post
Building a Serverless Ad Tracker: Scaling to Events and Back
paulhenri-l.com·10h·
Discuss: Hacker News
📮Message Queues
Flag this post
I use AI to synthesize all my datasets now
thefulldatastack.substack.com·11h·
Discuss: Substack
🏷️Attribute Grammars
Flag this post